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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including tine fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
05/18/09 has been entered. 

2. This office action is in response to correspondence filed 05/1 8/09 regarding 
application 10/812999, in which claims 1, 3, 4, 10, 11, and 12, and 17 were amended. 
Claims 1 and 3-17 are pending in the application and have been considered. 



Response to Arguments 

3. The amendment to the specification overcomes the objection to the specification, 
so it is withdrawn. 

4. Pages 6-8 of the Remarks argue that De Brabander does not teach or disclose 
two new limitations added to the claims. The first limitation further specifies "generating 
a two-dimensional graphical representation of a call flow", e.g. claim 1 line 3. The 
examiner agrees with page 6 of the Remarks that "De Brabander is directed to three- 
dimensional visualizations". However, in response to the assertion that De Brabander 
teaches away from "using a two-dimensional plane", the examiner respectfully 
disagrees. In the paragraph cited by page 6 ([0004]), De Brabander teaches "in a 2D 
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plane there isn't enough place for all states". Therefore, De Brabander teaches against 
using only two dimensions in the visualization. However in [0006] De Brabander 
teaches using a 3D visualization. A 3D visualization is simply a 2D visualization such as 
length and width with an added dimension of depth. Therefore, De Brabander must 
teach "using a two dimensional plane" in order to teach generating the 3D visualization, 
for at least the reason that each point in the 3D representation is necessarily associated 
with e.g. a width and length coordinate. The set of width and length coordinates 
inherently found within the 3D visualization may be fairly considered a "two-dimensional 
graphical representation" as found In e.g. claim 1 line 3 for at least the reason that the 
rendered display represents the width and length dimensions of the object. The 
"comprising" in the preamble of the claim does not rule out using other dimensions as 
part of a further total representation in addition to the "two-dimensional graphical 
representation" required by the particular claim limitation and therefore is not sufficient 
to patentably distinguish the claim from De Brabander. 

5. On page 7, the Remarks argue that De Brabander does not teach or suggest, 
and in fact, teaches directly away from "generating the graphical representation does 
not alter finite state machines in real time". First, the particular language of claims 1 and 
10 only requires "generating a two-dimensional graphical representation of a call flow 
which does not alter finite state machines in real time", and therefore it would seem by 
the grammar of the claim language that the limitation "which does not alter finite state 
machines in real time" refers back to the "two-dimensional graphical representation" 
rather than the "generating" step. If the limitation is intended to refer to the actual 
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"generating" step, it would require clarification such as found in claims 11, 12, and 17. 
Regardless, in De Brabander, neither the generating step nor the two-dimensional 
graphical representation of a call flow necessarily alter finite state machines in real time. 
For example, as was pointed on in the Remarks filed 04/1 7/09 on page 4, in [0527] of 
De Brabander teaches generating the context free grammar representation (the RTN) 
and then generating the graphical representation from the grammar representation. The 
grammar, which are a series of RTNs are only altered when the user makes a change 
to the visual representation and therefore are not altered when e.g. the graphical 
representation is generated as in lines 3-4 of claim 1 . 

Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claims 1 and 3-17 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over De Brabander (2004/0243387) in view of Yuschik (7,139,706). 

Consider claim 1, De Brabander discloses a computer implemented method of 
generating a language model (Abstract, developing grammatical models within an 
integrated development software environment), comprising: 
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generating a two-dimensional grapliical representation of a language model 
([0006], visualizing the models in 3D represents two-dimensions in addition to the third) 
which does not alter finite state machines in real time ([0527]); 

generating a context free grammar representation of the language model using 
the two-dimensional graphical representation ([0071-0072], the grammar is specified in 
RTNs, which are a network of FSMs coded in Backus-Naur Format, which are edited 
visually, see [0545-0547]); 

generating a finite state machine from the context free grammar representation of 
the language model, the finite state machine comprising a plurality of nodes including at 
least a first leaf node and at least a first root node ([0065], [0115], the FSMs are 
modeled with RTNs, which are coded in Backus-Naur Format); and 

generating a language model application code for a language model application 
from said finite state machine ([0061], compiling to create software), wherein said 
generating language model application code for said functions are executable during 
runtime of said language model application for walking the finite state machine from the 
at least one root to the at least one leaf of the finite state machine ([0617], links traverse 
the FSM). 

De Brabander does not specifically mention a spoken dialog application, or call 

flow. 

Yuschik discloses a spoken dialog application and modeling the dialogue in a call 
flow, using its graphical representation (Col 7 lines 23-27, the call flow design syntax is 
simulated using VISEO, which is a graphical representation, see Col 14 lines 43-40). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to use the invention of De Brabander to generate the grammar model for a 
spoken dialog application and call flow as taught by Yuschik, in order to realize the 
advantages of a user interface with the ability to receive inputs as voice signals, as 
suggested by Yuschik (Col 1 lines 46-50). 

Claim 10 is directed to a computer-readable medium for implementing the 
method of claim 1 , and so is rejected for similar reasons. 

Consider claim 1 1 , De Brabander discloses a system for generating a language 
model application (Abstract), comprising: a processor in communication with a module 
([0061], compiling software requires a processor reading instructions from a memory), 
wherein the module is configured to generate a finite state machine ([0065], [0115]) 
from a context free grammar representation of a language model ([0071-0072]) 
generated using a two-dimensional graphical representation of the call flow ([0006], 
visualizing the models in 3D represents two-dimensions in addition to the third), wherein 
generating the two-dimensional graphical representation does not alter finite state 
machines in real time ([0527]), wherein the finite state machine comprises a plurality of 
nodes including at least a first leaf node and at least a first root node ([0065], [0115]); 
and wherein the module is configured to generate application code using said finite 
state machine ([0061], compiling to create software), wherein the application code is 
generated dependent on how said finite state machine is traversed ([0617]), for 
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functions to be executed upon state transitions in said generated finite state machine 
([0617]), wherein said generated application code for said functions are executable 
during runtime of said application ([0061]), wherein the finite state machine is traversed 
from the at least one root to the at least one leaf of the finite state machine ([0617]). 

De Brabander does not specifically mention a spoken dialog application, or a call 

flow. 

Yuschik discloses a spoken dialog application and modeling the dialogue in a call 
flow using its graphical representation (Col 7 lines 23-27, the call flow design syntax is 
simulated using VISEO, which is a graphical representation, see Col 14 lines 43-40). It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
use the invention of De Brabander to generate the grammar model for a spoken dialog 
application and call flow as taught by Yuschik, for reasons similar to those of claim 1 . 

Consider claim 12, De Brabander discloses traversing a finite state machine 
([0617]), that is generated from a context free grammar representation of a language 
model ([0071-0072]) generated using a two-dimensional graphical representation of the 
call flow ([0006], visualizing the models in 3D represents two-dimensions in addition to 
the third), wherein generating the two-dimensional graphical representation does not 
alter finite state machines in real time ([0527]), and comprises at least a first root node 
and at least a first leaf node ([0617]); generating application code as said finite state 
machine is traversed from the at least one root to the at least one leaf of the finite state 
machine ([0617]), and invoking said generated application code for functions associated 
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with nodes in said finite state machine ([0061]), wherein each node of said finite state 
machine is mapped to a corresponding function ([0066], a state associated with a parse 
tree implies that state is mapped to a parsing function). 

De Brabander does not specifically mention a call flow. 

Yuschik discloses modeling the dialogue in a call flow using its graphical 
representation (Col 7 lines 23-27, the call flow design syntax is simulated using VISEO, 
which is a graphical representation, see Col 14 lines 43-40). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to use the invention of De Brabander to generate the grammar model for a call 
flow as taught by Yuschik, for reasons similar to those of claim 1 . 

Claim 17 is directed to a system for implementing the method of claim 12, and so 
is rejected for similar reasons. 

Consider claim 3, De Brabander discloses the graphical representation is 
generated using standardized graphical elements (Fig 8). 

Consider claim 4, De Brabander does not specifically mention the graphical 
representation is generated using VISIO. 

Yuschik discloses a graphical representation is generated using VISIO (Col 14 
lines 48-51). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the invention of De Brabander such that a graphical representation 
is generated using VISIO, since it is a desirable platform for decoupling user interface 
issues posed by the prompting structure, as suggested by Yuschik (Col 14 lines 46-48). 

Consider claims 5 and 14, De Brabander discloses the context free grammar 
representation is in a Backus-Naur Form format ([0072]). 

Consider claims 6 and 15, De Brabander suggests the context free grammar 
representation is in an augmented Backus-Naur Form format ([0071-0072], RTN is an 
extension of context free grammar, which suggests an extension, or at least an 
augmentation of Backus-Naur). 

Consider claim 7, De Brabander discloses a function is associated with a node in 
said finite state machine ([0387], a Function to add a looping 3DTransition between two 
different states). 

Consider claim 8, De Brabander discloses customizing generated application 
code ([0061]). 
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Consider claims 9 and 16, De Brabander does not specifically mention generated 
application code associated with an output function performs a table lookup prompt 
information. 

Yuschik discloses generated application code associated with an output function 
performs a table lookup prompt information (Col 5 lines 29-32, Fig 7A, 7B). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the invention of De Brabander such that generated application code 
associated with an output function performs a table lookup prompt information, in order 
to increase the accuracy of the ASR technology, as suggested by Yuschik (Col 18 lines 
36-37). 

Consider claim 13, De Brabander discloses the context free grammar 
representation is generated from a graphical representation of said language model 
([0071-0072]). 

De Brabander does not specifically mention call flow. 

Yuschik discloses modeling the dialogue in a call flow using its graphical 
representation (Col 7 lines 23-27, the call flow design syntax is simulated using VISEO, 
which is a graphical representation, see Col 14 lines 43-40). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to use the invention of De Brabander to generate the grammar model for a call 
flow as taught by Yuschik, for reasons similar to those of claim 1 . 
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Conclusion 

8. Any inquiry concerning this communication or earlier communications from tine 
examiner should be directed to Jesse Pullias whose telephone number is 
571/270-5135. The examiner can normally be reached on M-F 9:00 AM - 4:30 PM. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on 571/272-7843. The fax phone number 
for the organization where this application or proceeding is assigned is 571/270-6135. 

9. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 

/Jesse S Pullias/ 
Examiner, Art Unit 2626 

/Talivaldis Ivars Smits/ 
Primary Examiner, Art Unit 2626 

7/27/2009 



